A Guidance Tool for VGI Contributors

Many people are familiar with the VGI project OpenStreetMap (OSM), but there are many other projects that are not as well known to volunteers. What is needed is a tool that can help volunteers match their motivations, interests and background to appropriate types of VGI projects

HydroTest: a web-based toolbox of evaluation metrics for the standardised assessment of hydrological forecasts

This paper presents details of an open access web site that can be used by hydrologists and other scientists to evaluate time series models. There is at present a general lack of consistency in the way in which hydrological models are assessed that handicaps the comparison of reported studies and hinders the development of superior models. The HydroTest web site provides a wide range of objective metrics and consistent tests of model performance to assess forecasting skill. This resource is designed to promote future transparency and consistency between reported models and includes an open forum that is intended to encourage further discussion and debate on the topic of hydrological performance evaluation metrics. It is envisaged that the provision of such facilities will lead to the creation of superior forecasting metrics and the development of international benchmark time series datasets

How many people need to classify the same image? A method for optimizing volunteer contributions in binary geographical classifications

Involving members of the public in image classification tasks that can be tricky to automate is increasingly recognized as a way to complete large amounts of these tasks and promote citizen involvement in science. While this labor is usually provided for free, it is still limited, making it important for researchers to use volunteer contributions as efficiently as possible. Using volunteer labor efficiently becomes complicated when individual tasks are assigned to multiple volunteers to increase confidence that the correct classification has been reached. In this paper, we develop a system to decide when enough information has been accumulated to confidently declare an image to be classified and remove it from circulation. We use a Bayesian approach to estimate the posterior distribution of the mean rating in a binary image classification task. Tasks are removed from circulation when user-defined certainty thresholds are reached. We demonstrate this process using a set of over 4.5 million unique classifications by 2783 volunteers of over 190,000 images assessed for the presence/absence of cropland. If the system outlined here had been implemented in the original data collection campaign, it would have eliminated the need for 59.4% of volunteer ratings. Had this effort been applied to new tasks, it would have allowed an estimated 2.46 times as many images to have been classified with the same amount of labor, demonstrating the power of this method to make more efficient use of limited volunteer contributions. To simplify implementation of this method by other investigators, we provide cutoff value combinations for one set of confidence levels

Harmonizing and combining existing land cover/land use datasets for cropland area monitoring at the African continental scale

Mapping cropland areas is of great interest in diverse fields, from crop monitoring to climate change and food security. Recognizing the value of a reliable and harmonized crop mask that entirely covers the African continent, the objectives of this study were to (i) consolidate the best existing land cover/land use datasets, (ii) adapt the Land Cover Classification System (LCCS) for harmonization, (iii) assess the final product, and (iv) compare the final product with two existing datasets. Ten datasets were compared and combined through an expert-based approach to create the derived map of cropland areas at 250m covering the whole of Africa. The resulting cropland mask was compared with two recent cropland extent maps at 1km: one derived from MODIS and one derived from five existing products. The accuracy of the three products was assessed against a validation sample of 3591 pixels of 1km regularly distributed over Africa and interpreted using high resolution images, which were collected using the Geo-Wiki tool. The comparison of the resulting crop mask with existing products shows that it has a greater agreement with the expert validation dataset, in particular for places where the cropland represents more than 30% of the area of the validation pixel.JRC.H.4-Monitoring Agricultural Resource

Harmonizing and combining existing land cover and land use datasets for cropland area monitoring at the African continental scale

Mapping cropland areas is of great interest in diverse fields, from crop monitoring to climate change and food security. Recognizing the value of a reliable and harmonized crop mask that entirely covers the African continent, the objectives of this study were to (i) consolidate the best existing land cover/land use datasets, (ii) adopt the Land Cover Classification System (LCCS) for harmonization and (iii) assess the final product. Ten datasets were compared and combined through an expert-based approach to create the derived map of cropland areas at 250m covering the whole of Africa. The resulting cropland mask was compared with two recent cropland extent maps at 1km: one derived from MODIS and one derived from five existing products. The accuracy of the three products was assessed against a validation sample of 3591 pixels of 1km² regularly distributed over Africa and interpreted using high resolution images, which were collected using the agriculture.geo.wiki.org tool. The comparison of the resulting crop mask with existing products shows that it has a greater agreement with the expert validation dataset, in particular for cropland above 30%.JRC.H.4-Monitoring Agricultural Resource

Citizen Science: What is in it for the Official Statistics Community?

Citizen science data are an example of a non-traditional data source that is starting to be used in the monitoring of the United Nations (UN) Sustainable Development Goals (SDGs) and for national monitoring by National Statistical Systems (NSSs). However, little is known about how the official statistics community views citizen science data, including the opportunities and the challenges, apart from some selected examples in the literature. To fill this gap, this paper presents the results from a survey of NSS representatives globally to understand the key factors in the readiness of national data ecosystems to leverage citizen science data for official monitoring and reporting, and assesses the current awareness and perceptions of NSSs regarding the potential use of these data. The results showed that less than 20% of respondents had direct experience with citizen science data, but almost 50% felt that citizen science data could provide data for SDG and national indicators where there are significant data gaps, listing SDGs 1, 5, and 6 as key areas where citizen science could contribute. The main perceived impediments to the use of citizen science data were lack of awareness, lack of human capacity, and lack of methodological guidance, and several different kinds of quality issues were raised by the respondents, including accuracy, reliability, and the need for appropriate statistical procedures, among many others. The survey was then used as a starting point to identify case studies of successful examples of the use of citizen science data, with follow-up interviews used to collect detailed information from different countries. Finally, the paper provides concrete recommendations targeted at NSSs on how they can use citizen science data for official monitoring